PCT 



WORLD INTOLLBCTOAL PROPERTY ORGANIZATION 
International Bureau 




INTERNATIONAL APPUCATION PUBUSHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(51) Intematlonal Patent Ciassiflcation ^ : 




(11) International Publication Number: 


WO 97/28429 


GOIJ 4/00» GOIN 21/00 


Al 


(43) International Publication Date: 


7 August 1997 (07.08.97) 



(21) International AppUcaHon Number: PCT/US97/00994 

(22) International FUlng Date: 22 January 1997 (22.01.97) 



(30) Priority Data: 
594.696 



31 January 1996 (31.01.96) US 



(71) Applicant: GENERAL SCANNING INC. [USOJSl; 500 Arse- 
nal Street. Waiertown, MA 02172 (US). 

(72) Inventors: SVETKOFF, Donald, J.; 3630 Huron Court, Ann 
Arbor, MI 48103 (US). KILGUS, Donald. B.. T; 903 
Devonshire Boulevard, Brighton, MI 48116 (US). 

(74) Agents: S YROWIK. David. R. et aL; Brooks & Kushman. 22nd 
floor. 1000 Town Center, Souftftcld. MI 48075 (US). 



(81) Destenated States: CA, JP. KR, European patent (AT. BE. CH, 
I^ DK. ES, Fl. PR, GB, GR. IE. IT. LU. MC. NL, PT. 
SE). 



Published 

With international search report. 



(54) TtUe: METHOD AND SYSTEM FOR SUPPRESSING UNWANTED REFLECTIONS IN AN OPTICAL SYSTEM 
(57) Abstract 

A method and system are provided for suppi^sing or filtering multiple reflections which conupt photomettic or h^ght mea^^^ 
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METHOD AND SYSTEM FOR SUPPRESSING 
UNWANTED REFLECTIONS IN AN OPTICAL SYSTEM 

Technical Field 

This invention relates to methods and systems 
5 for suppressing or filtering unwanted reflections in an 
optical system. 

Background Art 

Over the past several years the benefits of 3D 
imaging for metrology and inspection has been recog- 

10 nized. Applications of 3D imaging range from microelec- 
tronics inspection to mobile robot navigation, with data 
rates from a few hundred points per second to video 
rates. Accuracy of these systems is limited, at the 
most fundamental level, by the underlying physics of the 

15 imaging process. 

Illumination DiBtribution an d Imaging Errors 

In all 3D systems the distribution of incident 
illumination upon a detector is analyzed in some manner, 
and the corresponding temporal or spatial variations 

20 analyzed to estimate the object reflectance and/or 
depth. Usually, the centroid of the intensity distribu- 
tion is analyzed to determine the position of a point on 
the object surface. As such, position dependent anoma- 
lies which corrupt the intensity distribution lead to 

25 inaccuracies which may vary from a negligible "noise" 
contribution to visible artifacts producing very large 
errors which may render the imaging system useless. 
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Early researchers in computer vision recog- 
nized the importance of the physics of imaging and the 
image formation process for scene modeling and under- 
standing. For instance, Horn in his article entitled 
5 "Understanding Image Intensities," Artificial Intelli- 
gence (1977) pp. 201-231, considered numerous imaging 
phenomena, including the effect of "mutual illumina- 
tion, when investigating the relationship between 
observed image intensity and surface characteristics and 
10 geometry. 

Barrow and Tennenbaum, in their article 
entitled "Recovering Intrinsic Scene Characteristics 
from Images," Computer Vision Systems (1978) pp. 3-26, 
developed a model of "Intrinsic Images," which related 

15 an array of intensity values and physical surface 
properties like depth, reflectance, and surface orienta- 
tion. They were cautious, however, to limit their model 
based upon assumptions about the illumination, including 
a limitation requiring that no secondary reflections be 

20 present. Violation of this assumption would render the 
model invalid because of the ambiguous interpretation of 
a single image. 

3D Imaging and Errors Caused bv Inter -Reflections 

Many real -world imaging applications involve 
25 estimation of more complex geometries. Objects having 
such geometries and, in particular, concave shapes are 
susceptible to the occurrence of multiple reflections 
within the instantaneous field of view ("IFOV"), thus 
leading to ambiguous image data. The reflections of the 
30 energy by the surface which allow the imaging to take 
place may be either specular (direct) , diffuse (scat- 
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tered) , or, usually/ components of both. The multiplic- 
ity of image points falling on the sensor can make it 
impossible to determine the correct height estimate, as 
only one point represents the true object point of 
5 interest. The ambiguity generally leads either to an 
uncertain choice as to which is the correct image point 
or a weighted average of the various image points which 
lead to an incorrect estimate. 

A large percentage of 3D imaging techniques 
10 now in use are based upon the triangulation principle . 
Several references discuss the limitations of instru- 
ments based upon triangulation, the most well known 
limitation being occlusion effects. 

However, there are fewer studies discussing 
15 the less obvious, but perhaps even more severe, limita- 
tion associated with secondary reflections (also called 
intra- scene reflections, inter-reflections, mutual 
illumination, secondary illumination, multiple reflec- 
tions, self illumination, multiple scatterings, etc.). 
20 The problem originates from energy received by a detec- 
tor which is reflected from the object point of interest 
to other regions of the scene prior to being received by 
the detector. 

The problem is inherent in all triangulation 
25 based systems because the necessary extended IFOV along 
the position sensing axis allows for integration of 
secondary reflections. It is not uncommon for the 
secondary reflected beam to contain a strong specular 
component exceeding the signal obtained from the point 
30 of interest, thereby invalidating a typical naive 
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assumption that the largest intensity reading corre- 
sponds to the point of interest . 

It is important to note that the 3D imaging 
problem, particularly for triangulation based imaging, 
5 can become very complex when imaging curved, specular 
surfaces which also produce partial occlusion. As 
taught by Barrow and Tennenbaum noted above, the stray 
light associated with the occluded regions can be 
stronger or competitive with primary returns from other 
10 points of interest. 

Steep slopes and small radii of curvature 
which are on the order of the system resolution lead to 
extreme requirements for electronic and optical dynamic 
range. Perhaps a worst case scenario to consider is 
15 thread gaging of a shiny, fine pitch screw with view- 
point of the triangulation receiver constrained as shown 
in FIGURE 1. Such a scenario requires very wide elec- 
tronic and optical dynamic range. 

Prior Art Solutions for Reducing Imaging Errors 

20 - Intra-Sce ne Reflections 

Spatial filtering methods taught in the art 
have been reasonably successful for reduction of second- 
ary reflection components along the scan direction (i.e. 
substantially orthogonal to the position sensing dimen- 

25 sion) . 

U.S. Patent 4,553,844 (Nakagawa et al . ) de- 
scribes filtering of strong multiple reflections which 
corrupt 3D data for measurement of solder joints. The 
IFOV along the scan direction is limited to a narrow 
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strip within an object scanned system in which a 
"descanning" method is used. There is no discussion, 
however, about suppression of errors along a position 
sensing axis . 

5 U.S. Patent 4,643,578 (Stern) teaches the use 

of a programmable mask in a detector plane synchronized 
with motion of a laser spot to reject strong background 
energy. Unwanted energy resulted from welding are glare 
and ambient light. This method allows for synchroniza- 
10 tion with standard t,v, sensors and eliminates moving 
parts . 

U.S. Patent 4,634,879 (Penney) and U.S. Patent 
4,645,917 (Penney et al.) describe the use of a small 
mask to reject background light in a similar laser scan- 
15 ning/descanning system, performing a similar function. 

"Synchronous scanning" techniques as described 
in these references have inherent spatial filtering 
capability. 

However, the required IFOV substantially along 
20 the position sensing direction often allows for much 
stronger secondary reflection components to be received, 
particularly for systems having extended depth of field 
requirements where surfaces are located in close proxim- 
ity. In restricted application scenarios, like micro- 
25 electronics inspection, reduction in this error can be 
achieved with appropriate adjustments of the viewpoint 
and the use of multiple sources and detectors and 
knowledge based data processing techniques. Examples are 
shown in the above co-pending applications, U.S. Patent 
30 4,529,316 (DiMatteo) , U.S. Patent 5,118,192 (Chen et 



wo 97/28429 



PCT/US97/00994 



-6- 

al . ) , U.S. Patent 4,891,772 (Case et al.) and a commer- 
cial IPK system manufactured by Panasonic Inc. 

In U.S. Patents 5,024,529 and 4,796,997 
(Svetkoff et al . ) , the use of a mask, preferably one 
5 which is programmable, is taught in which the IFOV along 
the height (position sensing dimension) is correlated 
with the height profile of the object to be inspected. 
If the mask is used with appropriate polarizers, the 
polarization delivered to the detector can be selected. 

10 Inherent in the laser scanning (transmitter) system is 
a beam of linear or circular polarized light incident 
upon the object (produced by the combination of a laser 
and AO deflector) . The use of polarization discrimina- 
tion in conjunction with the mask was suggested in the 

15 '529 patent for eliminating errors associated with shiny 
objects like metallic interconnects in electronics 
industry: wire bonds, pin grid arrays, ref lowed solder, 
etc. 

Another method to suppress or filter multiple 
20 reflections is to orient the projection and imaging 
subsystems so as to be symmetric about the normal to the 
surfaces to be imaged and utilize matched linear polar- 
izers in the two subsystems. In this method only 
specular reflections are deemed to be of interest. 
25 Secondary and tertiary reflections which remain within 
the IFOV are of necessity; the product of at least one 
diffuse reflection. Since diffuse reflections are known 
to partially de-polarize incident light, these reflec- 
tions are suppressed by the linear polarizer in the 
30 second subsystem. This technique is not useful for 
objects which have complex, sharply varying, or concave 
surfaces, however, as the symmetric orientation condi- 
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tion will generally not be met unless the orientation of 
the projector and the receiver are adjusted. 

In U.S. Patent 5,028,138 (Wolff), a polariza- 
tion-based method for material classification is dis- 
5 closed in which specular and diffuse con?>onents result- 
ing from multiple reflections can be distinguished. The 
method is based upon a receiver oriented to receive 
specular reflected light. A multiplicity of received 
polarization components are analyzed. 

IQ pcT published application WO 94/09463 disclos- 

es an apparatus for detecting ice or snow on a surface 
including a linear polarizer and a wave retarder plate 
which charges linearly polarized light into circularly 
polarized light. 

15 Recent polarization -based research work 

disclosed by Clark et. al. in their articles entitled 
"Polarization Based Peak Detection in Triangulation 
Range Sensors" and "Improving Laser Triangulation 
Sensors Using Polarization," 0-8186-7042-8/95 IEEE also 

20 demonstrates specific improvements in triangulation 
based imagery with the use of polarization discrimina- 
tion as suggested in the aforementioned earlier work. 
A LCD camera is preferred to analyze three polarization 
component images (typically with 0*, 45*, and 90' 

25 analyzer orientations) to reduce or eliminate the 
ambiguity associated with the important case of metal - 
metal inter-reflections. The cited work in progress 
will be extended to dielectric and translucent surfaces. 
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- Instrument 'Based B^ck-Ref lections 

Yet another problem can arise to further 
corrupt the measurements. Back reflection from the 
instrument onto the scene can modify the intensity 
5 distribution, particularly when multiple detectors are 
used (which are intended for the purpose of reducing 
reflection artifacts in addition to eliminating occlu- 
sion) . It is known in the illumination and spectral 
measurement art that wedged windows are useful for 

10 eliminating second surface reflections which normally 
occur with parallel windows, and such reflections 
corrupt spectral measurements. An increase in the wedge 
angle provides for increased reflected beam angular 
separation at a distance. Although not widely document- 

15 ed, in commercial fiber optic systems, back-reflection 
introduces non- uniformity in the delivered illumination 
and thermal effects at the source which is sometimes 
reduced by tilting the light source with respect to the 
fiber by several degrees. 

20 "Self imaging" effects called "narcissism" are 

considered in imaging system design (i.e., see, for 
example, W.L* Wolfe, "Imaging Systems," Infrared Hand- 
book, Infrared Information and Analysis Center, 1978, 
Chapter 19, pp. 19-22,19-23). A single detector views 

25 a constant field and stray radiation is negligible ♦ The 
back reflection problem just described is different in 
that 1) a second detector receives a weak component of 
reflected light from the point of interest; 2) the 
object is sequentially illuminated; and 3) the second 

30 detector receives a significant component of stray 
reflected energy. In the reference cited immediately 
above, it is noted that spurious reflections can cause 
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crosstalk with neighboring elements of a detector array, 
the reflections originating from other surfaces within 
the optical system, 

- B^ck'Ref lection Effects on Lase r Beam 

5 Furthermore, systems utilizing lasers for 

scanning a beam or projecting a line can be degraded by 
"feedback light*" Specular (or semi -specular) back 
reflection from the scene may induce destructive inter- 
ference in the laser and induce improper laser opera- 
10 tion. In effect, the scene, in combination with optical 
surfaces, acts like an external cavity mirror. In prior 
art systems, optical isolators were used to eliminate 
this undesirable phenomena. 

Summary O f The Invention 

15 It is an object of the present invention to 

provide a method and system which suppress unwanted 
reflections in optical systems with the addition of 
little hardware, and with minimal modifications to the 
optical system. The effects of both scene and instru- 

20 ment -based inter-reflections are eliminated while 
simultaneously isolating a laser source of the optical 
system from scene back-reflections. Such a method and 
system for suppressing inter-reflections is particularly 
important in a 3D imaging system, or whenever measure- 

25 ment of the intensity distribution is required. 

Another object of the invention is to provide 
a method and system which suppresses unwanted reflec- 
tions in optical systems which utilize a measure of the 
intensity or intensity distribution of electromagnetic 
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energy such as incident light. The method and system 
reduce errors caused by instrument and scene inter- 
reflections to negligible levels, thereby improving 
performance of such optical systems. 

5 Yet another object of the present invention is 

to provide a method and system to suppress unwanted 
reflections of an optical system by utilizing a trans- 
mitted beam of electromagnetic energy polarized in a 
first rotational sense to eliminate unwanted back 
10 reflection into a laser diode cavity, yet provide for 
reduction of detected object inter- reflections by means 
of polarization discrimination or selection in a receiv- 
er of the optical system. 

Yet still another object of the present 
15 invention is to provide a method and system to suppress 
unwanted reflections in an optical system having multi- 
ple detectors by reducing errors caused by back reflec- 
tion from one of the detectors which is then reflected 
from a surface in the scene and then received by another 
20 one of the detectors. 

Another object of the present invention is to 
provide a method and system for suppressing unwanted 
reflections in an optical system to allow for reduction 
of triangulation angle (for example, 20' or less) 
25 through suppression of strong, secondary reflection 
components, particularly on metallic surfaces by ex- 
ploiting known polarization characteristics associated 
with narrow angles of incidence. 

Yet a further object of the present invention 
30 is to provide a method and system for suppressing 
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unwanted reflections in an optical system while having 
a minimal impact on the hardware components and package 
dimensions of the optical system. 

In carrying out the above objects and other 

5 objects of the present invention, a method is provided 
for suppressing unwanted reflections in an optical 
system. The imaging system includes a source of elec- 
tromagnetic energy and optical elements for directing a 
beam of the electromagnetic energy to an object having 

10 a point of interest. The object is capable of reflect- 
ing the beam of electromagnetic energy to obtain 
reflected electromagnetic energy. The imaging system 
also includes a receiver having a detector for col- 
lecting the reflected electromagnetic energy. The 

15 improvement of the method includes the step of polariz- 
ing the beam of electromagnetic energy in a first rota- 
tional sense. The polarized beam of electromagnetic 
energy is incident upon the point of interest of the 
object. The method further includes the step of filter- 

20 ing the reflected electromagnetic energy wherein re- 
flected electromagnetic energy having the first rota- 
tional sense is attenuated and reflected electromagnetic 
energy having a second rotational sense substantially 
opposite to the first rotational sense is passed. 

25 Consequently, unwanted reflections from locations other 
than the point of interest on the object are suppressed 
and back reflections to the source of electromagnetic 
energy are substantially eliminated. 

Further in carrying out the above objects and 
30 other objects of the present invention, another method 
is provided for suppressing unwanted reflections in an 
optical system including at least one detector having a 
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surface normal. The detector back-reflects a fraction 
of electromagnetic energy received from a scene to be 
imaged along a first axis to obtain back- reflected 
electromagnetic energy. The improvement of the method 
5 includes the step of maintaining the detector so that 
the surface normal of the detector is in a fixed, non- 
colinear relation to the first axis . The method further 
includes the step of preventing the back- related elec- 
tromagnetic energy from reaching the scene. The back- 
10 reflected electromagnetic energy is not received by any 
other detector of the imaging system. 

Still further in carrying out the above 
objects and other objects of the present invention, 
systems are provided for carrying out the methods of the 
15 present invention. 

Similar methods involving tilting of a detec- 
tor are useful in dual sensor 3D systems as shown herein 
and can be incorporated without special modifications of 
the detector window, substrate geometry, or metalliza- 
20 tion properties. 

The well documented properties of the circular 
polarization solution is convenient and very efficient 
as a single passive optical element rejects the unwanted 
beam. Hence, it is advantageous to use circular polar- 
25 ization in the transmitter beam when a laser-based 
system is used. 

A well-known aspect of polarization theory is 
the 180 degree phase shift of a linear polarized compo- 
nent of a electromagnetic wave upon specular reflection 
30 from a surface. Also well-known is that circular 
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polarization, being described as arising from the 
combination of two orthogonal linear polarization 
components, is reversed in state from right-handed to 
left-handed or vice versa as a result of a specular 
5 reflection. The handedness of the polarization defines 
which of the two linear components of the circular 
polarized beam is leading the other in phase by 90 
degrees. It follows, then, that multiple reflections 
will lead to polarization state reversals back and forth 
10 between right- and left-handed with odd or even number 
of reflections. 

One useful application of the above described 
phenomenon is the use of a circular polarizer (often, 
but not always, a combination of a linear polarizer and 

15 a quarter- wave retarder) in the projector subsystem of 
an active 3D imaging system to suppress direct reflec- 
tions from the object back into the projector subsystem. 
Circular polarizers pass waves of a particular handed- 
ness of circular polarization while blocking waves of 

20 the opposite handedness. For instance, a circular 
polarizer might be used which, by design, transmits only 
left-handed circular polarized (LCP) energy. After the 
state reversal of a direct reflection, the transmitted 
LCP wave becomes right-handed circular polarized (RCP) 

25 and is blocked from re-entry into the projector subsys- 
tem. 

A first embodiment of the present invention 
entails utilization of a pair of circular polarizers, of 
opposite handedness from one another, in the respective 
30 beam paths of the projector and imaging subsystems. 
Thus the projector subsystem might transmit an LCP wave. 
Since the desired imaging of the points of interest 



wo 97/28429 



PCT/US97/00994 



-14- 

entails a single reflection, we expect an RCP wave to 
enter the imaging subsystem. Inclusion of an RCP- 
passing circular-polarizer in the imaging subsystem, 
then, allows imaging of the points of interest. Howev- 
5 er, when an object geometry arises such that two reflec- 
tions occur within the imaging subsystem IFOV, the 
portion of the wave which undergoes the two reflections 
will be LCP again and will be blocked by the imaging 
subsystem circular polarizer. 

10 Thus, when a laser source is utilized, it is 

isolated from back reflections from the scene while at 
the same time secondary scene reflections are at least 
partially suppressed in the receiver subsystem. 

A second embodiment of the present invention, 

15 which may or may not be used in conjunction with the 
first embodiment,^ is to utilize tilted image detectors 
so that back reflections to the scene from the sensor 
are angularly deviated from the incoming beams . Since 
triangulation systems with multiple imaging subsystems 

20 and image sensors generally orient the optical axes of 
such subsystems to be substantially symmetric about the 
normal to the scene being imaged and to exist in a plane 
which is perpendicular to the surface, a beam back- 
reflected from the sensor to the scene will, if not 

25 angularly deviated in some manner, reflect in a substan- 
tially specular manner from the scene into the opposite- 
ly oriented sensor. By utilizing a tilted detector, 
which may have a substantial reflectance value, the 
present invention creates a situation whereby any back 

30 reflections from the sensor will be substantially extin- 
guished by optical baffles or similar means within the 
receiver subsystem. 
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The invention of the first embodiment is an 
improved imaging method in an imaging system having a 
beam of electromagnetic energy, optical elements for 
directing said beam of electromagnetic energy to an 
5 object having a point of interest and capable of scat- 
tering or reflecting energy, and a receiver system 
having a detector for collected reflected or scattered 
energy. The improvement comprises 1) a transmitted beam 
of circularly polarized electromagnetic radiation having 

10 a first rotational sense, incident upon a point of 
interest on said object; and 2) a receiver having a 
circular or elliptical polarizer, where the circular or 
elliptical polarizer rotational sense is oriented 
substantially opposite to that of the transmitted beam 

15 of circularly polarized radiation. Secondary and other 
even numbered reflections from locations other than 
point of interest on object are suppressed with the 
receiver circular polarizer while simultaneously sup- 
pressing unwanted back reflections from the scene to the 

20 laser source. 

The invention of the second embodiment in- 
cludes an improved imaging method in an imaging system 
having at least one detector which back-reflects a 
fraction of received electromagnetic energy to a scene 

25 to be imaged. The improvement comprises 1) orienting 
the detector at an angle so as to separate the angle of 
reflection of the back-reflected energy from the inci- 
dent beam; and 2) intercepting the back reflected beam 
with a surface disjointed from the scene to be imaged. 

30 The back-reflection to the scene is substantially 
eliminated and not received by any detector in the 
system. 
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The above objects and other objects, features, 
and advantages of the present invention are readily 
apparent from the following detailed description of the 
best mode for carrying out the invention when taken in 
5 connection with the accompanying drawings. 

Brief Description Of The Drawing s 

FIGURE 1 is a schematic view of a prior art 
imaging system which shows the problem of thread gauging 
where readings at both sensors are in error as a result 
10 of partial occlusion and multiple reflections; 

FIGURE 2 is a schematic view of another prior 
art system which illustrates the problem of inter- 
reflections (and occlusion) as observed when imaging the 
leads of an integrated circuit chip providing a scenario 
15 where both readings are again potentially in error; 

FIGURE 3 is a schematic view of a triangula- 
tion-based imaging system which illustrates a method for 
imaging with optical isolators in the transmitter and 
receiver of the system where a surface normal at the 
20 point of interest produces specular reflection at a 
first receiver; 

FIGURE 4 is a schematic view of a laser-based 
transmitter system which illustrates the use of a 
circular polarizer for isolating the system from back 
25 reflection; 

FIGURE 5 is a schematic view of a triangula- 
tion-based imaging system which illustrates a method for 
imaging with optical isolators in the transmitter and 
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receiver of the system, where a surface normal at the 
point of interest produces specular reflection onto the 
background which is again reflected to a first receiver 
of the system; 

FIGURE 6 is a schematic view of a silicon 
photodiode which illustrates a problem of back reflec- 
tion observed from the photodiode despite the use of a 
anti -reflection coated window thereon; 

FIGURES 7a and 7b are schematic views of a 
dual detector system which illustrates corruption of a 
measurement in the system caused by 1) back reflection 
from the detector surface, 2) specular reflection from 
the scene, 3) with specular reflection received by a 
second detector; 

FIGURE 8 is a schematic view of an imaging 
system which illustrates the effect of slight detector 
tilt, with observed reduction in error exceeding lOOX; 
cuid 

FIGURE 9 is a schematic view of an imaging 
system including an isolator pair and tilted detector. 

B^St Mode For Carrying Qui The Invention 

While preferred embodiments of the invention 
are discussed separately herein, the two methods and 
systems can be used alone or in combination with one 
another. 
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Uslna A Pair of Circular Polarizera 

A first embodiment of the method and system of 
the present invention includes a transmitter subsystem 
or transmitter 1 and a receiver subsystem or receiver 2 
5 of a triangulation-based system as illustrated in Figure 
3. Each subsystem 1 or 2 includes an optical isolator, 
generally indicated at 8 or 12, respectively, or equiva- 
lent circular polarizers. The system may be a triangu- 
lation-based system, or other imaging system where the 
10 receiver 2 and the transmitter 1 are angularly disposed 
with respect to each other. 

The transmitter 1 includes a laser assembly or 
laser diode source 3 which produces a collimated laser 
beam 4 which is usually linearly polarized and, after 
15 transmission through optical components, is directed 
toward an object 5 such as a solder ball. 

If desired, any scanning methods taught in the 
art of measurement or laser scanning can be utilized to 
irradiate a plurality of object sample points without 
20 departing from the scope of the invention. 

Appropriate combinations of beam expansion or 
reduction optics are included in a transmitter optical 
system 6 with a focusing lens 7 to deliver a beam of 
electromagnetic energy to the object 5. Included, 

25 preferably in the collimated beam path, is the optical 
isolator 8 which converts radiation such as light to a 
circularly polarized beam. If the beam convergence 
angle is narrow (i.e. high f/#) the isolator 8 may be 
placed in the converging path, but polarization effi- 

30 ciency is degraded if the angles are wide. Likewise, it 
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is desirable to restrict the angles of incidence of 
collimated rays (i.e. scan half angle < 10 degrees) 
whenever the isolator 8 is placed beyond a beam deflec- 
tor. 

5 If a diffractive scanner (i.e. acousto-optic 

deflector) is used to scan the object 5, the output 
polarization may be chosen to be circular (or linear) 
and the isolator 8 (or circular polarizer) may not be 
required. However, the primary purpose of the isolator 

10 8 is to prevent back reflected energy (specular or 
highly polarized "semi-specular" reflection) from 
entering the laser cavity and should provide a high 
extinction ratio. Although circular polarizers for the 
near IR laser diodes often used exist, a preferred 

15 method for fabricating the isolator is to use Near IR 
linear polarizers designated as "Polarcor^"" provided by 
Corning, Inc., which provide extinction ratios of 500:1 
or greater; almost a ten- fold improvement over the laser 
polarization ratio and substantially better than the 

20 polarization ratio of the diffractive scanner. 

As shown in Figure 4, the complete isolator 8 
(circular polarizer) is preferably constructed by 
cementing a quarter wave Mica or Quartz retarder 9 
(waveplate) obtained from Karl Lambrect, Inc. to a 

25 linear polarizer 10 on appropriate sides so as to 
construct right or left-handed circular polarizers. 
Alternatively, a polymer retarder can be used such as 
the NRQ Series provided by Meadowlark Optics, Inc. A 
deep optical, anti-reflective coating, such as a V-coat, 

30 is recommended to reduce internal reflections or ghost 
images. Yet another alternative is a commercially 
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available dichroic circular polarizer, provided the 
performance is sufficient. 

The basic operation of the isolator is shown 
in FIGURE 4 where back reflection from a specularly 
5 reflective surface such as a mirror 11 is reversed in 
polarization and hence blocked. If two mirror surfaces 
are used the original sense is preserved and the beam is 
transmitted. The metallic surfaces to be imaged are 
normally rough on a scale compared to the laser wave- 
10 length (as opposed to polished) ; so the reflected beam 
will actually be elliptically polarized and the effec- 
tive isolator extinction is reduced, but the energy in 
the back reflected beam is both scattered outside the 
acceptance angle of the transmitter and retro-reflected. 

15 The circularly polarized beam shown in Figure 

3 {preferably scanned with an acousto-optic deflector 
and an optical isolator) is incident on the object 5 
and, after specular reflection from a metallic surface 
thereof, is substantially reversed in polarization. The 

20 optical isolator 12 in the receiver 2 is shown adjacent 
to a telecentric receiver lens 13 of the receiver 2 for 
clarity but may be disposed in other locations in the 
path, preferably where beam angular variations are 
minimal (a recommended location being a telecentric stop 

25 to minimize the recfuired clear aperture and cost) . In 
any case, the extinction ratio, which varies somewhat 
with angle of incidence, is the key isolator parameter. 

The isolators 8 and 12 can be identical in 
construction except for retarder axes are offset by 90 
30 degrees to produce opposite sense circular polarized 
beams. If RCP (Right Circular Polarized) radiation is 
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incident on the object 5, the reflected beam will be LCP 
(Left Circularly Polarized) . For instance, if a normal 
outward angle 14 of the illuminated surface element in 
Figure 3 is angled away from the transmitter 1 and 
bisects the angle between the transmitter 1 and receiver 
2 then a specular reflected beam, reversed in polariza- 
tion, is collected by the receiver lens 13 and transmit- 
ted through a receiver optical system 15 to an image 
sensor or detector 16 (rather than to the laser diode 
source 3) . The receiver isolator 12 is oriented oppo- 
site the transmitter isolator 8 in that the beam first 
passes through the retarder before passing through the 
linear polarizer which allows the specular reflection to 
pass . 

5 A second, substantially identical, symmetri- 

cally placed receiver (not shown in Figure 3) collects 
a much weaker diffuse and approximately random polarized 
component which is partially transmitted (50% nominal) 
by an isolator of the second receiver through its. 

0 optical system to its detector. With the angled facet 
the feedback light to the laser diode source 3 is now 
negligible . 

In certain cases it may be desirable to 
utilize elliptical polarization analysis in the receiv- 

15 er, recognizing that circular and linear polarization 
are special cases of elliptical polarization. An 
elliptical polarizer may be constructed using a suitable 
compensation for the retarder, adjustable if so desired. 
Likewise, for imaging certain materials, particularly 

)0 metallic surfaces, a pair of elliptical polarizers, one 
each in the transmitter and the receiver, may be pre- 
ferred based upon analysis of the material properties. 
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For example, typical conductors used in the microelec- 
tronics industry are copper, tin lead, and gold. The 
optical constants of metals varies greatly but useful 
characterization has been achieved with ellipsometry 
5 (see, for example, Jenkins, White, "Fundamentals of 
Optics," Fourth Edition, 1976, pages 534-540). Such a 
priori knowledge of the material characteristics in 
conjuncton with a geometric model of the part may be 
used to optimize the receiver configuration, providing 
10 "matched polarization" filtering characteristics with a 
single image. Furthermore, combinations of geometric 
constraints/ material characteristics (dielectric or 
metal) for primary reflection and secondary reflection 
may be exploited* 

Both detector signals can be used if the 
dynamic range of the detector and signal processing 
electronics is sufficiently wide. However, often the 
specular component is strongly asymmetric. Further 
information regarding these system elements and solu- 
tions to the dynamic range and spot asymmetry problems 
can be found in US Patents 4,796,997 and 5,024,529, and 
the above-noted copending related applications. In each 
case^ the signals received by each detector and pro- 
cessed to compute depth are based upon an estimate 
obtained from each of the wide dynamic range signal 
processing channels. 

A key case to consider for the present inven- 
tion is when the specular reflected beam is neither 
directed to the receiver 2 nor retro-reflected to the 
30 transmitter 1. Referring to Figure 5, there is illus- 
trated an imaging system similar to the imaging system 
of Figure 3 (and consequently have the same reference 
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numerals) wherein it is shown that in many cases the 
energy is specularly reflected or scattered (often over 
a narrow angle) from the point of interest 17 to a 
neighboring surface 18 which has a sufficiently high 
5 reflection coefficient to produce detectable energy 
levels at the detectors (only one of which is shown at 
16) . 

As shown in Figures 1 and 2, secondary reflec- 
tion can render the imaging system useless for inspec- 

10 tion of metallic IC leads and more complex surfaces like 
screw threads. As shown in Figure 2, the first sensor 
suffers from the fundamental limitation of partial or 
complete occlusion, and the second sensor receives 
energy from the point of interest but an error from a 

15 secondary (specular) component is present. It is not 
uncommon for the secondary reflection reading to easily 
exceed the signal readings and produce false data, 
particularly if the secondary reflection has a strong 
specular component as shown in FIGURES 1 and 2 . 

20 Those skilled in the art will quickly recog- 

nize that an arbitrary number of cases can be formed by 
varying the shape (convex and concave) of the object 
surfaces and the surface (specular and diffuse) reflec- 
tion coefficients, and hence affect the resulting 

25 "purity" of the polarization. However, although not 
obvious from ray trace analysis, the "microfacet model" 
referred to by the above-noted reference Clark et al., 
predicts that secondary reflection, particularly from 
metal-metal surface reflections, will be sufficiently 

30 attenuated for polarization discrimination. The sense 
of the secondary reflection is substantially identical 
to that of the incident beam reflection and hence 
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attenuated by the isolator 12 thereby producing a 
negligible error contribution from the detector 16, 
provided that the isolator extinction ratio is high. It 
is important to note that specular secondary reflection 
components may exceed corresponding diffuse components 
representing the point of interest by several orders of 
magnitude. Conversely, diffuse secondary reflection 
components may be several decades weaker than the 
desired signal . 

It is further recognized that with regard to 
multiple reflections in which degree of polarization is 
at least partially preserved, a large number of second- 
ary illumination and surface angles may be encountered 
when only one point of interest is illuminated, and that 
each component reflection of that large number may have 
a unique eccentricity of elliptical polarization. Since 
the secondary reflections originate from a spatially 
varying assembly of object locations, a priori knowledge 
of the object geometry and material content may be used 
to construct a model from which the reflection behavior 
for a given area of interest may be predicted. Using 
this model, the preferred embodiment of the present 
invention may be optimized as follows: a fixed device 
with a varying degree of retardance over the field or 
over varying angles of incidence, depending on the 
location placed in the receiver, may be employed (in 
conjunction with a linear polarizer of optimized orien- 
tation) in place of the optical isolator 12 to maximize 
secondary reflection suppression for a particular object 
fitting the model . 

It is worthwhile to note that if the receiver 
isolator 12 is of incorrect handedness (i.e, the handed- 
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ness is identical to the handedness of the transmitter 
isolator 8), the resulting image will provide a very 
poor representation of the object geometry, with a high 
contrast error image produced by false data. Hence 
5 useful (random or strongly polarized) energy is rejected 
and large errors are introduced by accepted secondary 
reflected beams. 

Although the above embodiment was demonstrated 
with fixed orientations for each of the isolators 8 and 
12, it will be apparent to those skilled in the art that 
"dynamic" methods analogous to those described in the 
above-noted references can be adapted for further 
polarization discrimination. A natural extension is 
optimization of the method for use with dielectric, 
surfaces, or surfaces in which primary components are 
diffuse rather than specular- However, the results here 
indicate that large improvements were found with a 
static case. Improvements in device quality and tech- 
nology are needed to fully realize possible improvements 
with dynamic LCD based polarization cameras as the 
extinction ratios are marginal at best. A typical 
specification is 16:1, but 1000:1 has been demonstrated 
with Ferroelectric Devices, as produced by Display-Tech, 
Boulder CO. 

It is known in the art that rotating devices 
can be used to vary the angles of the analyzers, (receiv- 
er section) , but this requires multiple moving parts in 
the imaging head (which includes the transmitter and 
receiver) and is often undesirable. In any case, the 
30 circular polarization based method provides the addi- 
tional advantage of isolating the laser source 3 from 
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back reflections and further reducing instrument -based 
stray light and ghost images. 

Reducino Instrument Back Reflection 

In Figures 3 and 5 depth information is 
5 derived using the triangulation principle. The surface 
of the object 5 shovm on a specular reflecting dielec- 
tric film background surface 18, has a strong component 
of specular reflection (at the point of interest 17) 
which is directed toward the receiver 2, while a rela- 
10 tively weak diffuse component is received by a second 
receiver (not shown) placed symmetric and opposite the 
transmitter axis. The specular component is often 
strongly asymmetric which results in some position 
estimation error. More important, the specular compe- 
ls nent is very strong (directly proportional to surface 
reflection coefficient) while the diffuse component may 
be several orders of magnitude weaker (inversely propor- 
tional to product of the squares of the receiver f/# and 
standoff) . 

20 As shown in Figure 6, the detector 16, which 

may be a silicon detector, only converts a fraction of 
incident electromagnetic energy (passing through its 
window 22 from an imaging lens 23) into current and, 
even at more sensitive near IR wavelengths, about 3 0% of 

25 the energy is transmitted through the silicon to the 
mirror-like back surface metallization (defocused at 
this point) and retro-reflected with a second pass 
through the silicon producing a net 10% back reflection 
to the scene. 
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As shown in Figure 7b, a ghost image is formed 
by a combination of back reflection and additional 
specular reflection from the mirror- like substrate 
background 18 into a second receiver 19 introducing a 
5 large bias in the signal, where the error will easily 
exceed the weaker signal from the object (i.e. solder 
ball) surface with a surface normal directed away from 
the second receiver 19. 

For example, assume the solder ball surface 
10 has a 10% specular reflection component, optical element 
reflection losses of each receiver are negligible, 30% 
is transmitted by the detector 16 on each pass of the 
beam, and the substrate film is an 80% specular reflec- 
tor. The fraction of laser power represents a huge. 
15 error contribution from a detector 20 of the receiver 
19. If a laser with peak power of 40 mw like the 
Sharp LT-015MD or Spectra Diode Labs 5700 Series is 
used, then up to 960 uw of stray energy is available for 
a ghost image. The diffuse component of interest 
20 produces signals often corresponding to about 30-50 /xW, 
resulting in unusable optical signal-to-noise ratio. 
Although not all the stray energy may be delivered to 
the detector 20, it is clear that the potential for 
degradation is great. 

25 It is well known in the triangulation and off- 

axis imaging art that the Scheimpf lug imaging condition 
can be employed which defines the detector tilt to 
maintain focus over a depth range. However, it can be 
shown that this condition may not always be a practical 

30 choice for imaging at narrow triangulation angles 
(desirable for shadow reduction) and high magnification 
(to produce fine depth sensitivity as required for 
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microelectronics) . Often the detector is oriented 
nearly orthogonal to the line of sight. This, however, 
provides direct back reflection to the object. 

In a preferred embodiment of Figure 8, the 
5 detector 16 (as well as the detector 20 in a two receiv- 
er system) is oriented (from its dotted line position) 
at a slight angle (i.e. indicated by a solid line) which 
is large enough for the back reflected beam to impinge 
upon a scattering and absorbing surface such as a back 
10 surface of a lens mount or baffle 21. The higher the 
optical magnification of the receiver 2, the less the 
angular tilt required to "shunt" the beam. 

The preferred embodiment is successful in 
practice for measurement of ball grid arrays (EGAs) on 

15 a specular reflective background; an improvement of at 
least 2 decades in depth accuracy is typically realized. 
The specular back-reflected light would pose less of a 
problem if only a single receiver is used or if the 
background produced weak, scattered light. However, 

20 such a single receiver system is plagued by other shadow 
and secondary reflection errors. Back reflections from 
other optical elements such as the isolator 12, the lens 
13, and the optical system 15 within each of the receiv- 
ers 2 and 19 are negligible because of the action of 

25 their corresponding isolators (on odd numbered reflec- 
tions) and the use of deep optical coatings (.2% per 
surface reflection typical) . The problem of imaging 
specular targets on specular backgrounds is very common 
in the industry, demonstrating the importance of this 

30 optical error reduction method. 
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Other Embodiments 

An additional embodiment is foirmed by a 
combination of the two above-described methods. F*ur- 
thermore, the general teachings of U.S. Patent No. 
5 5,024,529 and other disclosed polarization and filtering 
techniques can be combined with the teachings herein to 
further improve performance. 

The use of the invention is illustrated herein 
primarily with triangulation based imaging systems. It 
10 is to be understood, however, that the principles 
described here are useful in many instruments, including 
laser radar, confocal microscopy, and systems used to 
quantify surface color, reflections, or other character- 
istics. 

15 While the best mode for carrying out the 

invention has been described in detail, those familiar 
with the art to which this invention relates will 
recognize various alternative designs and embodiments 
for practicing the invention as defined by the following 

20 claims. 
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What Is Claimed Is : 

!• A method of suppressing unwanted reflec- 
tions in an optical system including a source of elec- 
tromagnetic energy, optical elements for directing a 
5 beam of the electromagnetic energy to an object having 
a point of interest, the object being capable of re- 
flecting the beam of electromagnetic energy to obtain 
reflected electromagnetic energy, and a receiver having 
a detector for collecting the reflected electromagnetic 

10 energy, wherein the improvement comprises the steps of : 
polarizing the beam of electromagnetic energy 
in a first rotational sense, the polarized beam of 
electromagnetic energy being incident upon the point of 
interest of the object; and 

15 filtering the reflected electromagnetic energy 

wherein reflected electromagnetic energy having the 
first rotational sense is attenuated and reflected 
electromagnetic energy having a second rotational sense 
substantially opposite to the first rotational sense is 

20 passed whereby unwanted reflections from locations other 
than the point of interest on the object are suppressed 
and back reflections to the source of electromagnetic 
energy are substantially eliminated. 

2. The method of claim 1 wherein the elec- 
25 tromagnetic energy is light energy. 

3 . The method of claim 1 wherein the beam of 
electromagnetic energy is elliptically polarized. 

4 . The method of claim 3 wherein the beam of 
electromagnetic energy is circularly polarized. 
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5. An improved method for suppressing unwant- 
ed reflections in an optical system including at least 
one detector having a surface normal and which back- 
reflects a fraction of electromagnetic energy received 
5 from a scene to be imaged along a first axis to obtain 
back-reflected electromagnetic energy, wherein the 
improvement comprises the steps of: 

maintaining the detector so that the surface 
normal of the detector is in a fixed, non-colinear 
10 relation to the first axis; and 

preventing the back-reflected electromagnetic 
energy from reaching the scene wherein the back-reflect- 
ed electromagnetic energy is not received by any other 
detector of the imaging system. 

^5 6. A system of suppressing unwanted reflec- 

tions in an optical system including a source of elec- 
tromagnetic energy, optical elements for directing a 
beam of the electromagnetic energy to an object having 
a point of interest, the object being capable of re- 
20 fleeting the beam of electromagnetic energy to obtain 
reflected electromagnetic energy, and a receiver having 
a detector for collecting the reflected electromagnetic 
energy, wherein the improvement comprises: 

means for polarizing the beam of electro- 
25 magnetic energy in a first rotational sense, the polar- 
ized beam of electromagnetic energy being incident upon 
the point of interest of the object; and 

means for filtering the reflected electromag- 
netic energy wherein reflected electromagnetic energy 
30 having the first rotational sense is attenuated and 
reflected electromagnetic energy having a second rota- 
tional sense substantially opposite to the first rota- 
tional sense is passed whereby unwanted reflections from 



wo 97/28429 



PCTAJS97/00994 



-32- 

locations other than the point of interest on the object 
are suppressed and back reflections to the source of 
electromagnetic energy are substantially eliminated. 

7. The system of claim 6 wherein the elec- 
5 tromagnetic energy is light energy. 

8. The system of claim 6 wherein the means 
for polarizing polarizes the beam of electromagnetic 
energy elliptically , 

9. The system of claim 8 wherein the means 
10 for polarizing polarizes the beam of electromagnetic 

energy circularly. 

10. The system of claim 6 wherein the means 
for polarizing includes an optical isolator. 

11. The system of claim 6 wherein the means 
15 for polarizing includes a polarizer. 

12. The system of claim 6 wherein the means 
for filtering includes an optical isolator. 

13. The system of claim 6 wherein the means 
for filtering includes a polarizer. 

20 14. An improved system for suppressing 

unwanted reflections in an optical system including at 
least one detector having a surface normal and which 
back-reflects a fraction of electromagnetic energy 
received from a scene to be imaged along a first axis to 

25 obtain back-reflected electromagnetic energy, wherein 
the improvement comprises: 
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means for maintaining the detector so that the 
surface normal of the detector is in a fixed, non- 
colinear relation to the first axis; and 

means for preventing the back- reflected 
electromagnetic energy from reaching the scene wherein 
the back-reflected electromagnetic energy is not re- 
ceived by any other detector of the imaging system. 
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^ because they relate to paxta of the international application that do not comply with the prescribed requiremenu to such 
an extent that no meaningful international search can be carried out, specifically: 

3. n CUimsNos.: 

because they are dependent claims and are not drafted in accordance with the second and third sentences of Rule 6.4(a). 

Box 11 Obscrratioiis where unity of invention b lacking (Contiauntion of item 2 of first sheet) 

This International Searching Authority found multiple inventions in this international application, as foUows: 
mease See Extn Sheet. 



Q As all required additbnal search fees were timely paid by the applicant, this international search repoit covers all searchable 



claima 



2. Q As aU searchable claims could be searched without effort justifying an additional fee. this Authority did not invite paymem 

of any additional fee. 

3. As only some of the required additional search fees were timely paid by the applicant, this international search report covers 
only those claims for which fees were paid, specifically claims Nos.: 



4. rn No required additional search fees were tunely paid by the applicant. Consequently, this international search report is 
restricted to the invention first mentioned in the claims; it is covered by claims Nos.: 



Rennurk on Protest The additional search fees were accompanied by the applicant's protest. 

fl^ No protest accompanied the payment of additional search fees. 
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BOX 11. OBSERVATIONS WHERE UNITY OF INVENTION WAS LACKING 
This ISA found multiple inventions as follows: 

Group I, claini(s)l-4, 6-13» drawn to a method of surpressing unwanted reAections of polarized light examination of 
surface reflection classified in class 
356/369. 

Group n. claim(8) 5 and 14, drawn to a method of surpressing unwanted reAections including at least one detector 
having a surface normal and which back reflecu a fraction of electromagnetic enetgy received from a scene to be 
imaged along a first axis to obtain back reflected electronnagnedc energy classified in class 250/559.18. 

The inventions listed as Groups I and II do not relate to a single inventive concept under PCT Rule 13.1 because, under 
PCT Rule 13.2, they lack the same or corresponding special technical features for the following reasons: In particular 
the polarized light examination of Group 1 docs not rely on the detector back reflection of Group II. Group II has 
seperate utility such as detection of diflUse light with discrimination of discrete light difftising region. 



Form PCT/ISA/210 (extra theet)(July 1992)« 



